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Abstract. We show how to insert time into the parameters of the Wilson's 6— j laws to construct 
discrete Markov chains with these laws. By a quadratic transformation we convert them into 
Markov processes with linear regressions and quadratic conditional variances. Further conversion 
into the "standard form" gives "quadratic harnesses" with "classical" value of parameter 7 = 
1 ± 2y/ar. For 7 = 1 + 2 v / ctt, a random-parameter-representation of the original Markov chain 
allows us to stitch together two copies of the process, extending time domain of the quadratic 
harness from (0, 1) to (0,oo). 

This is an expanded version with additional details that are omitted from the version intended 
for publication. 

1. Introduction 

The work on this paper started with an attempt to fit Markov processes with linear regressions 
and quadratic conditional variances into Wilson's 6 — j-laws from Wil80j. This required choosing 
appropriate time-parameterization of the laws so that we get a Markov chain, and the appropriate 
(quadratic) transformation of this chain so that conditional and absolute moments are given by 
simple enough formulas. 

Generically, processes with linear regressions and quadratic conditional variances can be further 
transformed ("standardized") so that they are described by five parameters, see [BMW071 Theorem 
2.2]. We expected Wilson's 6 — j laws to lead to the "classical" quadratic harnesses with the 
parameters tied by equality 7 = 1 — 2y / crr. But, to our surprise, depending on the range of 
parameters we also got quadratic harnesses with 7 = 1 + l^for. In the latter case, the initial 
construction gave only a quadratic harness with time (0,1). However, the underlying Markov 
chain is a mixture of simpler Markov chains. We used this mixture representation to extend the 
quadratic harnesses to (0, 00) by stitching together two conditionally-independent Markov chains 
with shared randomization. The stitching approach was suggested by the construction of the 
"bi-Pascal" process with 7 = 1 + 2y / err in |Jam09] ; our argument is modeled on |BWllbj . 

The paper is organized as follows. In Section [2] we use Wilson 6 — j laws to construct quadratic 
harnesses on (0, 1) or on (0, 00), depending on the range of parameter C. These are Case 1 and 
Case 2 of Theorem 12.51 In Section [3] we represent Markov chain from Section [2] as a mixture of 
"simpler" Markov chains. We also confirm that each of these Markov chains transforms into a 
quadratic harness with 7 = 1 and a = (which is our justification for the adjective "simpler" 
in the previous sentence.) In Section EH we stitch together a pair of such quadratic harnesses into 
the quadratic harness on (0,oo), thus extending the process from Case 1 of Theorem 12.51 to the 
maximal time domain. 

The expanded version of this paper with additional technical or computational details is posted 
on the arXiv. 
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1.1. Quadratic harnesses. In |BMW07] the authors consider square- integrable stochastic pro- 
cesses on (0, oo) such that for all t, s > 0, 

(1.1) E(Z t ) = 0, E{Z s Z t ) = min{s, £}, 

and for s < t < u, E(Zj|J r SiU ) is a linear function of Z s , Z u , and Var[Z 4 | J- SjV \ is a quadratic function 
of Z S1 Z u . Here, J 7 ,^ is the two-sided ex-field generated by {Z r : r G (0, s] U [«, c>o)}. Then (II. ip 
implies that 

(1.2) E(Z t | J",,,,) = — Z s + — Z u 

It — S M — S 

for all s < t < u, which is sometimes referred to as a harness condition, see e. g. |MY05j . 

While there are numerous examples of harnesses, the assumption of quadratic conditional vari- 
ance is more restrictive. For example, all integrable Levy processes are harnesses, but as deter- 
mined by Wesolowski [ Wes93 j , only a few of them are also quadratic harnesses. Under certain 
technical assumptions, [BMW07, Theorem 2.2] asserts that quadratic variance has the following 
form: there exist numerical constants r], 8, a, r, 7 G R such that for all s < t < u, 



;i.3) Vai[Z t \F s>u ] 



(u-t)(t-s) ( uZ s -sZ u Z u - Z. 

1 + i] h 



u(l + as) + r — 7s \ u — s u — s 

(uZ s — sZ u ) 2 [Z u — Z s ) 2 (Z u — Z s )(uZ s — sZ u ) 

(u-s) 2 (u-s) 2 ~ [ ~ 7J (u - s) 2 

Definition 1.1. We will say that a square- integrable stochastic process {Z t )t^T is a quadratic 
harness on T with parameters (rj, 8, a, r, 7), if it satisfies (II. ip . (11.211 and (11.311 on an open interval 
T which may be all of or a proper subset of (0, 00). We also assume that the one-sided conditional 
moments are as follows: for < s < t < u in T, 

(1.4) E[Z t \T> u ] = l-Z Uj 

(1.5) E[Z t \ JT< S ] = Z s , 

(1.6) Var[Z t \F <s } = (aZ 2 + V Z S + l) , 

1 + as v ' 

(1.7) Var[Z^> n ] = t^LlA ( r % + 8^ + 1 V 



u + r \ u 2 u 

We remark that on infinite intervals, formulas (jl.4til.7p follow from the other assumptions, see 
jBMW07l (2.7), (2.8), (2.27), and (2.28)]. 

We expect that quadratic harnesses on finite intervals are determined uniquely by the param- 
eters. This has been confirmed under some technical assumptions when the parameters satisfy 
additional constraints, of which the main constraint seem to have been that — 1 < 7 < 1 — 2^far. 

It is known, see [BMW07J, that for quadratic harnesses on (0,oo), parameters a,r are non- 
negative, and that 7 < 1 + 2^/or. Quadratic harnesses with 7 = 1 — l^far were called "classical" 
in |BMW07] . Quadratic harnesses with 7 = 1 + 2y/ar could also have been called "classical", 
but there had been no examples of such processes until the bi-Pascal process was constructed in 
|Jam09j . The bi-Pascal process does not have higher moments so large part of general theory 
developed in [BMW07J does not apply. Our interest here is in providing additional examples of 
quadratic harnesses with 7 = 1 ± 2y/ar. 
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2. Quadratic harnesses with finite number of values 

A family of quadratic harnesses (Z t ) with two values appears in |BMW08l Section 3.2]. These 
processes have parameter 7 = —1 and their trajectories follow two quadratic curves. Since 1, Z t , 
are linearly dependent, the parameters in (II. 3p are not determined uniquely. In fact, one can show 
that for this family of processes the admissible parameters in (ll.3p can take any real values a, r G E 
(positive or negative) such that or ^ 1 and any 77, 6 e R, such that 

(r]T + 0)0? + 9a) + (1 - or) 2 > 0. 

Quadratic harnesses with finite number of values, including two values, appear also in [ BW1CH 
Section 4.2]. The processes constructed there have parameter 7 < 1 — y/ar. 

In this section we construct (non-homogeneous) Markov processes which take a finite number 
of values and we show how to transform them into quadratic harnesses with 7 = 1 ± lyfor. These 
processes are different from the previous ones even in the case of two- values; this can be seen from 
analyzing the curves they follow, see Figure [TJ Somewhat surprisingly, processes corresponding to 
7 = 1 ± \/ar are described by the same formulas for transition probabilities, differing only in the 
range of one of the parameters that enter the formulas. 

Our construction is based on Wilson's [Wil80] 6 — j laws. As in |Wil80t (3.5)] we fix integer 
N > 1 and assume that 

(2.1) a > -1/2, be (-a, a + 1), and either c>a + Noic<—a — N + l. 

(The choice of the range for c will later affect the properties of the quadratic harness.) 
For AT e IN and k = 0, 1, . . . , JV, define 

/ 00 x ( h \ n ( h \ (?a) k (a + l) k (a + b) k (a + c) k (-N) k 

(2.2) Pk,N{a, b, c) = C N {a, b, c) 



k\(a) k (a - b + l) k (a - c + l) k (2a + N + l) k 
where the normalizing constant is 

(a - b + l) N (a - c + 1) N 



(2.3) C N (a,b,c) 



(2a+l) N (-b-c + l] 



N 



and (a) k = T(a + k) /T(a) = a(a + 1) ... (a + k — 1) is the Pochhammer symbol. 

When the parameters are such that numbers Pfc 5 jv(a, b, c) are well defined, then the sum over all 
k = 0, . . . , N is one; this is |Wil80t formula (3.4)] applied to m = n = 0. So under assumption 
fl2~T]) . from jWi!80l (3.4)] one reads out that 



A' 



(2.4) u(dx) = ^p fc ,iv(a, b, c)5 k (dx) 



k=0 



is a probability measure on {0, 1, . . . , iV}. 

The following algebraic formula will be used several times. 

Lemma 2.1. For k = 0,1, ... ,N, j = 0,1, ... , k, 

mK\ Pj, k (a,b,a + k + 25)p k)N (a + 5,b + 5,c) . . . . 

(2.5) —— — = p k ^ jiN -j(a + j + 5,-a-j + 5,c). 

Pj, N {a, b,c + 5) 

Proof. Multiplying both sides of (12. 5 j) by pj^(a, b,c + 5), expanding them by the use of (12.21) and 
(12.3jl . canceling out common terms and grouping the remaining ones, we observe that (12.51) would 
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follow if we verify that LHS = RHS with 

THq = 1 (2a + 25) k (2a + 25 + k) 3 

(2a + l) fc (2a + k + 1), (2a + 25 + l)jv(2a + 25 + iV + l) k 1 + + Jfc 

(a + g + l) fe (-2g-fc + l) fc (a-c + J+l) JV (a + o + 25) fc (_fc) J -(-iV) fe 
(a + 5) fc (—25 — + l)j (a-c + 5 + l) fc (-a -6-25- fc + 1)* fe! 

and 

(2a + 2j + 1)^ 



(2a + l)jv(2a + iV + l)j(2a + 2j + l) k -j 

(a + c + 5)j(a + c + 5 + j) f 



(2a + 25 + 2j) k -j 

(2a + 25 + 2j + l)„_,(2a + 25 + j + iV + ^ ' "^"^'"* " 



(a + 5 + j + l) k _j {a-c + 5 + j + l) N -j 



(a + 5 + j) k _j ~ J (a-c + 5 + j + l) k _j 

(a - c - 5 + 1) N (j -Ap^-iV), 

(a - c - 5 + l) 3 -(a - c - 5 + j + l)yv-j (A; - j)! 

To perform the verification, we will use the following simplification rules 

(2.6) (a) N (a + N) M = {a) M+N , 

(a + L + 1) M -l a + M 



(2.7) 
(2.8) 

From f )2.6p it follows that 



(a + L) M _ L a + L 

(a) L a 



(a + 1)m+l (a + L) M +i 
(2a + 2j + 1)^ (2a + k + j + l) N _ k 



(2a + l)jv(2a + N + 1)^(20 + 2j + l) k .j (2a + 1)^+; 

(2a + k + j + l) N - k 



(2a + l) k+j (2a + 1 + k + j) N _ k (2a + l) fc (2a + k + l)j ' 

Similarly, ((23) and (ESD give 

{2a + 25 + 2j) k _j 

(2a + 25 + 2j + l)jv-i(2a + 25 + j + N + l) k _j 

(2a + 25 + 2j) fc _ i 2a + 25 + 2j 



(2a + 25 + 2j + l) N+k -2j (2a + 25 + k + j) N +i-j 
while applied to the analogous expression in LHS they give 

{2a + 2S) k (2a + 26 + k)j (2a + 25) k+j 2a + 25 

(2a + 25 + l)jv(2a + 25 + iV + l) k ~ (2a + 25 + l) k+N (2a + 25 + k + j)v+i-/ 

From (12. 6 j) we get 

(a + c + 5)j(a + c + 5 + j)fc-j = ( a + c + ^)fc> 

(a - c + 5 + j + 1)^- (a-c + 5 + l)Ar 

(a — c + 5 + j + l)fc_j a-c + 5 + l) fe 
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and (this expression appears only in RHS) 

(a — c — 5)n 



(a - c- 5 + i)j(a - c - 5 + j + l)jv-j 

From fl23D it follows that 



1. 



a + 5 + j + l) k -j a + 5 + k (a + 5+l) k a + 5 + k 

and 



(a + 5 + j) k -j a + 5 + j (a + 5) k a + 5 

For the remaining expressions from LHS we have 

(-^-k + l) k _ ( _ 1)k+j(25)h . and (a + b + 25) k _ k 

(-25 — k + l)j ~ 1} [2d)k ^ (~a-b-25-k + l) k - [ 1} ' 

Now, the above simplifications show that equality LHS = RHS is equivalent to 

(_ A; ) J (-iV), 2 q + 2£ a + ^ + fc fe 

fc! 1 J 1 jfc - J (2a + 25 + A ; + j)iv + i-, a + 5 1 J 

(j - N^-ji-N), 2a + 25 + 2j a + 5 + k 

(k-j)\ [ )k ^(2a + 25 + k + j) N+1 _ J a + 5 + j' 

which is easily seen to be true. Thus ( 12. 5ft is proved. 

□ 

In particular, by taking the sum over j in (I2.5P we have 

k 

(2.9) Pk,N(a + 5,b + 5,c) = y^j^a, b,c + 6)p k -j,N-j{a + j + 5, -a - j + 5, c). 

3=0 

Next we compute the moments of an auxiliary random variable associated with probability law 

(EU). 

Proposition 2.2. Suppose parameters a, b, c, N satisfy (12. ip . For k = 0, . . . , N , consider a ran- 
dom variable Y such that 

(2.10) Pi(Y = k(2a + k)) = p kjN (a, b, c). 
Then 

(2.11) E( r) = (i+jMi__ 

and 

_ iV(a - + iV)(a + 6) (a - c + N)(a + c)(6 + c) 

(2.12) Var(K) - ___________ . 

Proof. The proof is elementary for N = 0,1, as the law of Y is #o for N = and 

(a-6 + l)(a-c + l). (a + 6)(a + c) . 

d + 77; , TTTi , 7T"2a+l 



(2o+l)(-6-c + l) (2a + l)(6 + c-l) 

for JV = 1. 

For iV > 1 and > 1, we have 

, /„ , \ / , \ (a + b)(a + c)N . 

fc(2a + k)p k , N (a, b, c) = — — p fc -i.Ar-i(a + 1, b, c) 

+ c — A/ 
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which gives (12. lip . For k > 2, iterating the algebraic identity we get 

k(k - l)(2a + k)(2a + k + l)p k)N (a, b, c) 

(a + b)(a + b+l)(a + c)(a + c+l)(N -1)N . n t . 

= (6 + c-iV)(6 + c-iV + l) P*-*W« + 2 > & > c )- 

Noting that fc(A; - l)(2a + fc)(2a + fc + 1) = k 2 (2a + k) 2 - (1 + 2a)k(2a + k), we evaluate 

¥(Y *) _ (g + b)(a + & + l)(a + c)(a + c + 1)(JV - l)iV 
1 j " ( & + c _iV)(6 + c -iV+l) +^ + M) H Y) 

and (I2.12p follows by an elementary calculation. □ 

2.1. Markov chain. Now we introduce a continuous time (non-homogeneous) Markov chain on 
the finite state space {0, 1, ... , iV} with parameters A, B, C. We assume that N G IN, A > —1/2, 
B G (— A, A + l). For the third parameter, we will assume that either 

Case 1: C < -A - N + 1, 

or 

Case 2: C > A + N. 

These two cases will appear in several statements below. 
The Markov process will be defined for t G T, where 



r 



-(A + B), oo) in Case 1, 

(-(A + B),C- A-N) in Case 2. 



We remark that A + B > and that in Case 2 the interval T is non-empty, as C — A — N > 0. 

We also remark that the process in Case 1 is well defined on another interval (— oo, C — A — N). 
This second "component" of the process will be used to extend the quadratic harness from (0, 1) 
to (0, oo). (In fact, one should think that in Case 1, the process starts at —A — B at state 0, 
continues through oo = — oo and ends at state N at time C — A — N.) 

For s < t in T, define matrix P s t = \p Sj t(k, ^)]o<fc,n<Ar with entries 

(2.13) Ps,t{k, n) = p n - k ,N-k (^A+^ + k, -A - s + k,C - ^ 

if0<k<n<N, and let p s ,t{k, n) = for all other values fc,n£ {0, . . . , iV}. 

The following shows that matrices P St t are transition probabilities of a Markov chain. 

Proposition 2.3 (Chapman-Kolmogorov equations). For s < t <u inT, p Sj t(k,n) > 0, and for 
j <n< N, 

n 

(2.14) Ps,u{j,n) = ^2p Si t(j,k)p tiU (k,n). 

k=j 

Furthermore, 

N 

(2.15) ^ Pa , t (j,k) = l. 

k=j 

Proof. To verify (12. 14ft . we apply (12. 9 j) with parameters 

a = A + j+t/2, b= -A-j-s + t/2, c = C-u/2, 5 = (u-t)/2. 
Formula ( 12. 15ft is the already mentioned generic identity for the weights. 
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To verify that for < k < n < N we have p Sjt {k,n) > we verify assumption (12.11) . Here 
a = A + k + t/2, b= -A-k-s + t/2, c = C - t/2. We get 

a = A + k + t/2 > (A - B)/2 + k> -1/2 + k > 

as t > -(A + B), B < A + 1 and k > 0, 

b = -A - k - s + t/2 = -a + t - s > -a 

as t > s, and 

a + l-b = 2A + l + 2k + s>A-B + 2k + l>2k>0 
as s > -(A + B), B < A + 1 and k > 0. If C < -A - N + 1 then 

c = C - 1/2 < -A - N + 1 - 1/2 = -a - (N - k) + 1. 

If C > A + N then 

c-a = C- A-k-t>N-k, 

since t < C - A - N. 

□ 

Let (^)ter be the Markov chain constructed above, i.e. 

Pr(6 = n\£ s = k)= p Stt (k, n), < k < n < N. 
In particular, the univariate laws of the Markov chain are 

Pr(& = j) = P-a-bM J) = PjAA + t/2, B + t/2, C - t/2). 
For t ET, consider the process 
(2.16) Y t = (2A + t + 6)6 + A(A + t) = (A + t + £ t )(A + 6). 

Lemma 2.4. (Y t ) is a Markov process with mean 

A(B + C)(A + N)+NBC ^ A(B + C) + NC 
(2 - 17) E{Yt) - B + C-N + t B + C-N 

and variance 

Proof. The Markov property follows from the fact that the lines £k{t) = {A + t + k) (A + k) for 
= 0, 1, . . . , N do not intersect over t E T . Indeed, £k and £j intersect at t = — {2 A + j + k) < 

—2A — 1 < — (A + B). Therefore, the law J2Pt(.k)$k converges to the degenerate law 5 as 

t — > — (A + B) from the right. 

The formulas for the mean and the variance are now recalculated from Proposition 12. 2^ noting 

that Y t is in distribution Y + A(A + t) with Y given by fT2TTUD . □ 

Of course, (Y t )ter naturally extends to the left endpoint by \\m t -^-{A+B) Y t = —AB in mean 
square and, for a separable version, almost surely. 
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Figure 1. Trajectories of process (YtjteT he on the family of lines. The process 
starts at line £q = {A + t)A, at t = —A — B and jumps up until it stops on a random 
line £ e = [A + t + Q)(A + 6) that it follows to oo. (Here, A = 0, B = 1/2, JV = 
4, = 3; for more on 9, see (13.141) .) 

From Proposition 12.21 we read out that for s < t the conditional moments are 

A-C + N + t C(A + N)(t-s) 



(2.19) 
(2.20) Var(Y t \Y s ) 



E(Y t \Y s )=Y s 



A-C+N+s A-C+N+s 



(A-C + N + t)(t-s 



(Y s + C{s - C)) (Y s -(A + N)(s + A + N)) 



(A-C + N + s) 2 (A -C + N + s-1] 
Indeed, p s>t (k, n) = p n ^ StN ^ s (A + t/2 + £ s , -A - s + t/2 - C - t/2). Recall 
(2.21) Cov(X, Y) = E(Cov(X, Y\U)) + Cov(E(X|Z7),E(y|Z7)). 

Using fl2T2TD with X = U = Y s , Y = Y t , from fl2TT8l) and fl2TT9l) we compute 

A-C + N + t 



(2.22) Cov(Y„Y t ) 



A-C + N + s^ 

N(A + C){B + C){A-B + N){A + B + s){A-C + N + t) 



(B + C - N) 2 (B + C - N + 1) 
We now compute the two-sided conditional distribution 

p r (£ = ju = k £ = m ) = Pr fe = Ms = k) Pr(£ M = m|& = j) = p 8 ,t( k >j)Pt,u(j,™) 

Pr(£« = rn\£ s = k) p s>u (k,m) 

The conditional probability is well defined and non-zero only for k < j < m < N, and then we 
have 

(2.23) Pr(& = j\£ a , Q = Pj ^ s> ^ s (A + £ s + t/2, -s + t/2 - A - ^ + A - t/2 + u). 
Indeed, from (12. 5p it follows that 

Pj_ fc ,jv-fc(a, b, c + S)p m _ jtN _ j (a + j- k + 5,-a-j + k + 5,c) 
p m - k , N - k {a + 5,b + 5, c) 

= pj- k>m - k (a, b,a + m- k + 25). 

Taking a = A + t/2 + k, b = -A - s + t/2 - k, c = C - u/2 and 5 = (u - t)/2, we get fl2T23|) . 

We now use (12.231) to compute the two-sided conditional moments. For fixed £ s = k, = m, 
we use (ETTTjl with a = A + k + t/2, b = -s + t/2 - A - k, c = m + A - t/2 + u and N = m — k 
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to compute E(F|£ S ,£ U ) where Y = — k)(2a + & — fc). Since Pr(F t = y|£ s = k,£ u = m) 
Pr(y + (A + k)(A + k + t) = y), reverting to k = £ s and m = £ u , we obtain 

E(Y t |6,^) = (^ + 6) (^ + * + 6) 

(* - s) - 6) (2^ + M + e s + &o 



+ 



u — s 

It t t 5 

-£ S (2A + s + &) + & (2A + u + £ tt ) + A(A + £). 



it — s it — s 

Hence a calculation based on ( 12. 16}) gives 

(u — t)Y H + (t- s)Y,. 

2.24 E(Y t \Y s , Y u ) = ± '-^-^ 

u — s 

Next, we use (12712]) with N = £ u -£ s , a = A+£ s +t/2, b = -s+t/2-A-£ s , and c = £ u +A-t/2+u 
to compute the conditional variance: 



Var(y^ s ,e«) 
where 



C t , s ,„(&, - - 6 + u - s){2A + s + 6 + f u )(2A + u + 6 + f„), 

(i_ a )( u _i) 



(it — s + l)(w — s) 2 
(« - t)(t - s) / (K - Y s f uY s - S F U 



This gives 

(2.25) Var(Y t \Y s ,Y u ) 

u — s + 1 \ [u — s) z u — s 

The following summarizes our findings and incorporates them as an appropriate transformation 
into a quadratic harness. 

Theorem 2.5. In Case 1, (Yt)teT can be transformed into a quadratic harness (Z t )t on T' = (0, 1) 
with covariance (11 .ID and the conditional variance (11.31) with parameters 

A(B + C + N) + C(B + C) + N(N - B) 



(2.26) r] 

(2.27) 9 



y/N(A + C)(B + C)(A - B + N)(N - 1 - B - C) 

A(B + C + N)- B(B + C-N) + 2CN 
^N{A + C){B + C){A - B + N){N -l-B-C) 
1 

2.28 o = t = , 

B+C-N-l 



(2.29) ; = 1 + 2^ B + c _ N + l . 

In Case 2, {Y t ) te j- can be transformed into a quadratic harness (Z t ) t on T' = (0, oo) with 
parameters 

A(B + C + N) + C(B + C) + N(N - B) 



n 





y/N(A + C)(B + C)(A-B + N)(B + C-N + 1) 
A(B + C + N)- B(B + C -N)+ 2CN 

^N{A + C){B + C){A-B + N){B + C-N + lY 
1 



a = t 



B+C-N+V 
and 7 = 1 - 2^ = (B + C - iV - 1)/(B + C-N + 1). 
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Proof. We shall use Proposition IA.1I Since Case 1 and Case 2 differ in some details, in order to 
treat them in a unified way we adopt the convention that e — 1 refers to Case 1 , and e = —1 refers 
to Case 2. We set 



(2.30) M = e(N - B - C)-\ 



N(A + C){B + C){A-B + N) 
e{N - 1 - B - C) ' 



noting that the expression under the radical is positive in both cases. Let ip = A + B, 5 
e(A - C + N), so that 5 - eip = e(N - B - C) > in both cases. We take 

_ A{B + C){A + N) +NBC _ A(B + C) + NC 
a ~ B + C-N ' ^ ~ B + C-N ' 

9 = 0,r] = —1, and define 

(2.31) X t = Y t - EY t , Z t = m(t)X m/m{t) , 
with 

/ooon »,s t(A-C + N)-e(A + B) , e-t 

(2.32) £(t) = y — and m(t) - 



M(N -B-C) w M(N -B-C) 

as defined in Proposition IA.1I Then by Proposition IA.ll (Z t ) is a quadratic harness, and the 
formulas follow by calculation. First, 

(A + C)(B + C)N(A-B + N) 
X P (B + C-N)* 

so 

Mjx = s(B + C- N)/y/e(A + C)(B + C)N(A -B + N)(N -1- B-C), 
and a = r = e/(N -1- B-C). Then, 

_ M(2/3e -5) _eM N 2 + (A - B)N + (A + C)(B + C) 
77 " x ~~ X B + C-N 

and 

M(2(3-jj) _ M (A- B)(B + C) + (A + B + 2C)N 
~ x ~ 7 X B + C-N • 

In view of Theorem 14.11 process (Z t ) in both cases can be defined on (0, oo) so the one-sided 
conditional moments are automatically of the correct form. However, we will still need some of 
the identities, so we give an argument, which we separate into a lemma. □ 

Lemma 2.6. (Z t ) satisfies ( [i.^Hi. 7| j with parameters, T],9,a,T as given in Theorem \2.5\ 

Proof. From (12.191) we get 

¥(x \x)- A - c + N + t x 

E{XtlXs) ~ A-C + N + s Xs > 
therefore (note that in both cases 1 1— > £(t)/m(t) is increasing) 

1 — es 

^>{Xe(t)/m(t)\Xe( s )/m{s)) = _ — Xt(s)/ m ( s )- 

Hence K(Z t \Z s ) = Z s . 
Next, from f|2T20]) we get 

VarWIX.HVarMY.)- {A — C + N + t)(t — s) 



(A-C + N + s) 2 (A -C + N + s-1) 

x [X s + C{s -C)+ EY S ] [X s -{A + N){s + A + N)+ EY S [ 
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and 

(1 -es) 2 (s-t) 



Vav(X m/m(t) \X e{s)/m{s) ) =e (i _ ^ + B + C _ N _ £S) 

^A + C)(B + C) ] \ v N(A-B + N) 



s — e 



x 



s — e 



This gives 



t — s 

Vax(Z t \Z s ) = m 2 (t) Vai(X e{t) / m{t ) \X £{s )/ m{s) ) = 1 + ffg (pZ s + r}Z s + 1) 



In order to prove (jl.4p and (11.71) . we define 

X t = Yl t , tet:= -T. 

Then (X t ) t is Markov, 

Pi(X t = (A- t + k)(A + k))=:p t (k) 

with 

Pt(k) := Pk, N ( A ~ t/2, B - t/2, C + t/2), k = 0,...,N, 
and a standard computation shows that 

Pr(X t = (A-t + n)(A + n)\X s = (A — s + k)(A + k)) =:p s ,t{k,n), 

where 

(2.33) p s , t (k, n) = Pritk (A - t/2, B - t/2, A - s + k + t/2), n = 0,...,k, 

(we let p s ,t(k, n) = for all other values k,n G {0, . . . , N}). From Proposition 12.21 it follows that 

A + B-t AB(t - s) 



(2.34) E(X t \X s )=X s 
and 

(2.35) Var(X t |X s ) 



A + B-s A + B-s' 

and 



(A + B — t)(s — t) (A(A -s)- X s ) (B{s - B) + X s ) 
~ (A + B -s) 2 (A + B-s + l) ' 

For t,u G T, t < u we have 

E{X t \X u ) = E(Y t \Y u ) - EY t = E (X_,|X_ U ) - EF t 

_ Y A + B + t AB{u-t) 
- r "A + B + u A + B + u *' 

we obtain that 

E(X f |X M )=X tt A + jB + t . 
v t\ u) ^ A + B + u 

Therefore 

E {X e (t)/m(t)\X eiu)/m{u) ) = _ ^X e{u)/m{u) , 
so (jl.4p holds true. Similarly, using (I2.35P we get 

(.A + B + t)(u-t) 



Var (X|X U ) 



(A + 5 + n) 2 (A + J B + M + 1) 

x + u) - X u - EY U ] [B{u + B)-X U - EY U ] 
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and 

t(u - t)(l - eu) 



Var (X m/m{t) \X e{u)/m(u) ) - u2{i _ £f)2[i _ £{l + B + c _ N)u] 

\{A + C)Nu 1 \^ (B + C)(A-B + N)u 

+ ^£(u)/m(u) £ r y^t(u)/m(u) 



X 



1 — eu 



u — e 

Since Yax(Z t \Z u ) = m 2 (t) Var (^(t)/ m (t)|-^(u)/m(u))> after a computation, we arrive at 

, , x t(u-t) ( Zl Z x 
Var (Z t \Z U ) = T _| + 0^ 

3. Extending quadratic harness: conditional representation 



□ 



The next two sections are devoted to the extension of the quadratic harness from Case 1 from 
(0, 1) to (0, oo). We follow the basic idea suggested by the generalized Waring process ( |Bur88a| 
IBur88bt IZX01] ). which gives rise to the quadratic harness on (0, 1). This quadratic harness can be 
extended to (0, oo) by representing the generalized Waring process as a negative binomial process 
with random parameter, and stitching together two such negative binomial processes that share 
the randomization, as in |Jam09] . Similarly, we extend the quadratic harness in Case 1 from (0, 1) 
to (0, oo) by representing it as a "Markov process with randomized parameter". This is assisted 
here by the heuristic that in Case 1 transition probabilities are positive on (— oo, C — A — N) U 
(— A — B, oo) so there is a natural pair of Markov chains to work with. These two Markov chains 
can be put together by requesting that they "match" at infinity, so the randomization is really 
based on 9 = lim^oo^. (It is clear that once we choose the cadlag trajectories for £ t , the limit 
exists almost surely.) 

In this section we analyze two such Markov process, and give the law of the parameter that 
represents process (CtjteT from Case 1 as a randomized process. We also give the "dual process" 
which after randomization would give "the second part" of Case 1 chain, that we did not consider 
in detail. In the next section we stitch together a pair of such processes. 

3.1. The auxiliary family of quadratic harnesses. In this section we construct the family of 

Markov processes (£t )t>-A-B which will give Markov process (£ t ) from Case 1 once the parameter 
K is selected at random according to the appropriate law. Heuristically, this process arises as the 
limit C — > — oo of the process (£ t ) from Case 1 with N = K. But for completeness and for clarity 
how the remaining parameters enter various formulas we go over the basic analytic identities. 

For K = 0, 1, . . . consider a three-parameter family of finitely supported probability measures 
J2f=o ^j^i®, b)5j on {0,1,..., K} with probabilities 

(q + 1-% (-l)'(-20i(o)i(&)i(l + o/2)i 
"i,K\ a i u ) — — 7~~r~T\ — 



(a + l) K jl(a + 1 - 6^(0/2)^(0 + 1 + K)j 

r K\ (g-b + j + ^K.j _ {b)j 

3j (a + 2j + l) K _ J ' (a + j)/ 

The natural ranges for the parameters are a > — 1, < 6 < o + 1, X G W, but we also allow 
K = with a degenerate law S . The fact that these numbers add up to 1 can be deduced e.g. 
from [Ask89, identity (9.s)] by taking the limit as c — > 00, e = e(c) — > —00 and d — > 00. However, 
it is convenient to observe that 

(3.1) iTj t K(a,b) — lim pj t jc(a/2, b — a/2, c). 
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We will rely on this relation for quick proofs of the identities we need. 
We will need moments of the related random variable. 

Lemma 3.1. If 

Pr(^ = j(a + j)) = ir jjK (a, b), 
then E(X) = Kb and Var(X) = K(K + a - b)b. 

Proof. This is recalculated from the limit as c — > — oo in Proposition 12.21 



□ 



(K) 

For each value of K, there is a Markov process £ t based on these probabilities: the process 
starts with ^l}_ b = and has transition probabilities 

(3.2) Pr(& ( * } = Mf > = m) = v^ K „ m (2A + 2m + t,t-s). 

(It is straightforward to check that these number are non-negative, and that the univariate laws 
are Pr(& (K) = j) = TT j , K (2A + t,t + A + B).) 

Lemma 3.2. The Chapman- Kolmogorov equations hold. 

Proof. The proof is based on the following the algebraic identity: 

(3.3) = Ma/2, 6 - a/2, a/2 + S + *), 

where Pj^ia, b, c) are the previous basic probabilities ( 12 .2p . This identity is recalculated from (12.51) 
using flXTj) . 

This implies Chapman-Kolmogorov equations in the usual way. We also get the conditional 
laws under bivariate conditioning: for s < t < u, 

(3.4) Pr^^tfO^O) 

= p._ d K )} d K)_ 6 K) (A + + t/2, - s + t/2-A- 6 K) ,ti K) + A-t/2 + u). 
(This laws are of course the same as (j2.23j) .) □ 

Next, we define the Markov process of our interest and state the relevant moment formulas. 
Proposition 3.3. Fort eT = {-A - B, oo), define Y t (K) = (A + t + & K) )(A + $ K) ). Then 

(i) (Yt K ^)teT i s a Markov process. 

(ii) For t> -A- B, 

(3.5) E(Y t {K) )=A 2 + (A + K)t + K(A + B). 

(iii) For -A - B < s <t, 

(3.6) Cov{Y} K \ Y t {K) ) = K(K + A - B){s + A + B). 

(iv) For -A- B < s <t, 

(3.7) E(y t w |yW) = + {A + JT)(t - s), 

(3.8) Var(y; (X) |y;W) = [(A + K){s + A + K) - Y™] (t - s). 
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(v) For —A — B < s < t < u, the two-sided conditional moments are 

E( yW.y(iO yM) = {u-t)Y™ + {t-s)Y™ 
s ' u u — s 



Var(yW|yW,yW) 



u — s + 1 11 w — s y it — s 

(vi) for —A — B < t < u, the reverse conditional moments are: 

W(yW\yW\ - y(K) A + B + t AB{u-t) 
H ** |y " ] ~ Yu A + B + u A + B + u' 

{K) _(A + B + t)(u - t) (Vj x) - A(A + «)) (y™ - B(u + B] 

Var(F, \Y U )- {A + B + unA + B + u + 1) " 

Proof of (i). (Y^^ter is a one-to-one function of {C,t K ^)teT- D 

Proo/ 0/ fn/ From Lemma O with a = 2,4 + t, 6 = A + £ + t, writing Y t {K) = X + A(A + t) we 
get (I3.5P and 

(3.9) Var(y/ K) ) = K(K + A — B)(t + A + B). 

(The latter will be needed for the proof of (13. 6p .) 

Alternatively, we can take the limit C — > —00 in Lemma [2.41 with N exchanged to K. 



□ 

Proof of (iv). Comparing ( 12 . 1 3[) and (13. 2p . in view of (13. ip . the conditional law of £ t |£ s converges 
as C — >■ 00 to the conditional law of £t l£« ■ Since the formulas for the Markov processes match, 
the conditional law Y^ \Ys is the limit as C — > —00 of the conditional laws of the process (Y t ) 
from Case 1 of Section [3 So we just pass to the limit in ( 12. 19ft and ( 12. 20ft . □ 



Proof of (Hi). This formula follows from ( 13 ,7p and (13. 9p . □ 
Proof of (v). Since the conditional laws ( 13 .4p are the same as ( I2.23p . we use ( I2.24p and (I2.25p . □ 
Proof of (vi). For t < u, and j < n < K < N, the reverse conditional laws are the same: 
(3-10) Pr(ef ) = Mi K) =n)= Pr(& = = n). 

This follows from the fact that two-sided conditional laws and starting points at t = —A — B are 
the same. 

□ 

Of course, Y t (K) ->■ —AB as t — >• —A — B. It may be more interesting to remark that once 

Y (K) 

we choose a separable version of the process, we have — t > A + K almost surely and in mean 

square as t — > 00. In particular, 

v (e) 

(3.11) ^-+A + Q 

almost surely and in mean square for any random G 6 {0,1,...}. 
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Proposition 3.4. If K > 1 then Markov process (Y} K ') te j- can be transformed into a quadratic 
harness (Z t ) t on (0, oo) with parameters 

1 e _ A-B + 2K 

V ~ y/K(A- B + K)' ~ y/K(A — B + K)' 

a = 0, t = 1, and 7 = 1. 

Proof. The simplest way to get this answer is to use Case 1 of Theorem 12.51 with N = K, taking 
the limit as C — > — oo of the quadratic harness (— y/— C Z- t /c)te(o,-c) ■ 

Alternatively, use Proposition 13.31 and Proposition IA.1[ keeping in mind that transformation 
Z t i — y aZ t / a 2 maps a quadratic harness with parameters 77, 9, a, r, 7 into a quadratic harness with 
parameters r]/a,9a,a/a 2 ,ra 2 ,j. 

□ 

3.1.1. Conditional representation. In this section we confirm that process (£t) from Case 1 of 
Section [2] can be represented as processes (£ t ) with random K. 
Denote 

/oiox tt / » n (c) N (a) k (-N) k 

3.12 U k (a, c; N) = 

(c- a) N k\{c) k 

These numbers are probabilities if c > 0, a < 1 — N, k = 0, . . . , N, see |Ask89j (l.s)]. For k > 1, 

aN 

kU k (a, c; N) = — — n fe _!(a + l,c+ 1;N — 1), 

a — c — A* + 1 

so if Pr(£7 = k) = U k (a, c; iV) then 

(3.13) E(f/) = 5?f , V «(I0- 0(0 " C+ 



a-c-iV+1' (c + A^-a-2)(c + N-a- l) 2 

Consider an auxiliary random variable G with values in {0, 1, . . . , A^} such that 

(3.14) Pr(0 = k) = U k (A + C,A-B + 1;N), k = 0, ...,N 
(This law was calculated from 9 = lim^oo^ in Case 1.) 

Remark 3.1. Recall the constraints introduced at the beginning of Section [27T1 In Case 1 with 
A > —1/2, B G (-A, A + 1), C < -A - N + 1, the right hand side of fl37UE|) is indeed positive: 
1 - B - C > N - 1 > 0, A - B + 1 > and A + C + AT < 1, so for k e {0, . . . , AT}, we have 

(A + C) k (-N) k = —N(A + C)(-N + 1)(A + C + 1) ... (-N + k - 1)(A + C + k - 1) > 0. 

In Case 2 with C > A + N, the right hand side of (I3.14p is negative when k + N is odd. 

Proposition 3.5. If & is random with law (I3.14p . and conditionally on & = K, process (^ 9 ^) is 
a Markov chain with transitions f 1 3 . 2 [) . then the unconditional joint laws are the Case 1 laws: for 

jl< ■■■< 3n, 

N 

(3.15) Pr ( = k ) Pr 4 fe) = Jn) = Pr(& = jx, . . . , = j n ), 
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where is the Markov process from Case 1 with parameters N, A,B,C . 

Proof. Let ( t = C,^ ■ Then (Ct)teT is a Markov chain regardless of the law of the randomization G. 
This follows from the fact that in reverse time the transition probabilities Ct^lC^ do not depend 
on K. 

Indeed, for t < u, 

Pr(C* = j\Cu = k,B) = p hk {A + t/2, B + t/2, A + u - s/2 + k)le> k 

= Ie> fc Pr(6 =M U = k). 

Since (£ f ) is a Markov chain conditionally on 0, and Pr(£ f < 0) = 1, for ji < j 2 < • • ■ < j n we 
have 

Pr(Cti = jl,---,Ct» = jn) 

/ 71-1 

= E (le> in Pr(C 4n = j n \Q) J] Pr (a = jV|a +1 = Jr+i, 6) 

r=l , 
71-1 

Pr(C<n = Jn) JJ Pr(6, = jr|& r+ i = jr+l). 
r=l 



To see that joint laws match, we observe that Markov processes have the same limiting distri- 
bution (13.141) and the same reverse transition probabilities, compare f)3.10p . 



Direct verification that Pr(( t = j) = Pr(£ t = j). We need to verify that 
v (A-B + 1) N {A + C) k (-N) k 



^ m _ B _ CWA _ B + 1)k ^A + t,t + A + 



ATI - H- OvlA - //-!- I >-. i " > ' 

k=j 

= p j)N {A + t/2, B + t/2, C - t/2). 

Equivalently, 

N 



^(a + c) k (-N) k (l-b-c) N 

1^ TT7 t I i \ TTj.fc 2«, a + b)= p j)N {a, b, c 

f^-f fc!(a - 6 + l) fc (a-6+ljAr 



This boils down to the following identity: 



N 



(31Q) \- (a + c) k (-N) k (-k) j 

1 ' ' f-f fc!(2a + l)*(2a + 1 + 

fe— j 

= / 1 w (Q-c+l) JV (o + c)j(-iV)j 

1 ' (2a + l) N (a-c+l) J (2a + N + 1)/ 



WILSON'S 6 - j LAWS AND MARKOV PROCESSES 



17 



Simplified form, see flM}, (1277]) . ( 1278]) is 



AT 



(a + c ) fc (-iV) fc (-A;) j _ , _ n ^ (a - c+ l)jv(a + c^-N^ 

k=j 

Thus 



kl(2a + l) k+j 1 J " (a-c+l) i (2a+l) JV+j 



A (a + c) fc (-l) fc+ j (a-c + j + ^Ar-^a + c),- 

^.{N — k)\(k — j)\(2a + l) k+j (2a + l) N+j (N - j)\ 



Renaming parameters o + c 4 a, a - c 4 6, 



3 



Equivalently, 



A (q) fc (-i) fc+J = (b + j + i^ja) 

y (iV - k)\{k - j)\(a + b + l) k+3 (a + b + l) N+j (N -j)V 



y, {a + j)k-j{-V k+j _ {b + j + l) N -j 

L. (iV - k)\{k - j)\{a + j + b + l) k (a + j + b+ 1) N (N 

K—J 



Renaming a + j t— > a 



(A r - k)\(k - j)\(a + b + l) k (a + b + l)jv(iV - j)! ' 
(a + b + 1)jv = (a + & + l)j(a + b + j + 1)n-j and b + j + 1 6 give 
A (a) fc _,(-l)^ _ (6)iv-i 



^ - - j)!(a + (a + 6)^(iV - j)< ' 

Changing the index of summation: k' — k — j, N' = N — j and dropping the primes, we get 

y> (a)k(-l) k _ (b) N 

2^(N-k)lkl(a + b) k (a + b) N NV 

Now rename a + b as c, 

y-v ,n, (a) fc (-l) fc = (6 - c) N 

ho (c) fc " (c) N ' 

and then "undo" the factorials 

TV 



E (a) k (-N) k = (6 - c)jy 



This casts (137161) into [Ask89, formula (l.s)]. 



□ 



3.2. The dual process. For A, B, C, N as in Case 1 and K — 0, . . . , N, we now introduce a dual 
Markov chain (C,^) with state space {if, . . . , N} and time T = (A + iV — C, oo). This Markov 
chain starts at Ca+n-c = N and jumps down according to the transition matrix P st = [p s ,t{h j)} 
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with entries 

(3.17) PsAhj) = n 3 ~K,i-K(2A + 2K - t, 2A + % + K - s), 

i = K,K + l, . . . ,N, j = K, K+l, . . . ,i. (The remaining entries of this (N-K + l) x (N-K + l) 
matrix are zero.) 

In particular, the univariate laws of the dual Markov chain are 

Pr(£ W = j) = k 3 -k,n-k{ZA + 2K-t,A + C + K). 

To confirm that Markov chain (Q ) te f is well defined, we prove the following. 

Lemma 3.6. For s < t in T , the entries of transition matrix P s t are non-negative, and the 
Chapman- Kolmogorov equation holds, i.e. for s < t < u, we have 

P.<s,u = P.s,t x Pt,u- 

Proof. Fix s < t < u and K<k<j<i<N. We first establish an identity that will play the 
role of (13. 3 p in this argument. Taking the limit b — > oo in (12. 5 p we get 

^ (2a + 2 ^ C+ / a + ^ (2a ' 2a + J + 2 ^ ) = Pj _ ki _ k (a + k + 5,-a-k + 5,c). 
7r fc) j(2a, a + c + o) 

We use this identity with 5 = (u — 1)/2, a = A + K — u/2, c = A + K + i + t/2 — s, and then shift 
the indexes, replacing i,j, k by i — K,j — K,k — K respectively. This gives 

tx,^ k ^ k (2A + 2K - t, 2A + i + K - s)n k _ KJ ^ K (2A + 2K - u, 2A + j + K - t) 
^ ' ' n k _ Kti _ K (2A + 2K - u, 2A + i + K - s) 

= Pj~k,i-k(A + k — t/2, u-t/2- A - k,i + A + t/2- s). 

From (13. 181) we deduce the Chapman-Kolmogorov equation, and also we determine the two-sided 
conditional law Pt(^ K ^ = j\Q K ^ = h^L^ = k). (We omit the verification that the entries are 
non- negative.) 

Here is a direct verification of the non-negativity of the transition probabilities. After a 
simplification we get 

n U i) =( l ~ K \ ~ *) ~ ~ 3 ~ (2A-S + K + i)j_ K 

PsA,J) \j-Kj {2A-t + 2j + l) l _ j ^A-t + K + j)^ 

We are going to use the fact that if u e T and C < —A — N + 1 (as in Case 1), then 
2A-u < -2N + 1. 

For i — j the first fraction is 1; for i > j, since 

-{t - s) - {i - j - 1) < -(t - s) <0, 
2A-t + 2j + l<2A-t + j + i< -2N + 1 + i + j < 0, 

sign(— (t — s) — (i — j — = sign(2v4 — t + 2j + and the first fraction is non-negative. 

Similarly, if j = K then the second fraction is 1; otherwise 

2A-s + K + i<2A-s + i + j-l< -2N + i + j < 0, 

2A — t + K + j<2A — t + 2j — l < -2N + 2j < 0. 

Hence sign(2A — s + K+i)j_ K = sign(2A— t+K+j)j_ K , and the second fraction is non-negative. 



□ 
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Next, noting again that the lines £j(t) = (t — A — j)(A + j) do not intersect over T, we define 
the corresponding Markov process 

Y t {K) = (t-A-^)(A + ? t K) ) 
We will need formulas for the absolute moments. 
Lemma 3.7. 

(3.19) E (y t (K) ) = (A + K)t -{A + K){A + N)~ C(N - K), 
and for s < t, 

(3.20) Cov (?} K \ y t (jP °) = (K + A + C){N - K){N + A - C - s). 

Proof. For the mean and variance, we use Lemma 13.11 with a = 2 A + 2K — t, b = A + C + K and 
with K there replaced by N — K. Then = K + £, where £ is a random variable such that 
X = (a + So = -X - (A + K)(A + K — t), and we get both fl3~T9|) and the formula for 
the variance that matches (13.201) when s = t. 

Next, we apply Lemma [3711 to the conditional law (I3.17p . Here a = 2A + 2K — t, b = 2A + ^i K ^ + 
K — s, and the value of K in Lemma 13.11 should now be replaced by fs — K. So conditionally 
on we can represent f^ as K + f , where f is a random variable representing X = (a + f )f . 
Thus conditionally on £i we can represent Y} again as —X — ( A + X) (A + — t) . Since the 
mean of X is (g*° - IT) (2 A + + K - s), we get 

E(y W|yW) = (g A ') - tf)( s - - - X) - (A + AT) (A + X - 1) 
= (s - A - £ { S K) )(A + } ) + (A + K)(A + K — s) — (A + K)(A + K — t). 

Thus 

E (yW|yW) = rf) + (A + K)(t - s). 

This gives the covariance: from f)2.2ip we deduce that 

Cov(yW,y f ^)=Var(rW). 

□ 

Next, we describe how to get the "second half of the quadratic harness from Theorem 12 .51 

Proposition 3.8. If & has law (13.141) then (Y"/ e - ) ) ig ^ can be transformed into quadratic harness 
on (l,oo) with parameters as in Theorem \2.5\ 

Sketch of the proof. We use the fact that (C,l e ^) t€ f has the same distribution as the time reversal 
of the original process (^ t ) te f so Y^ = —Y-t- With s < t < u, this implies that 

r ,on wfyOh _ , A(B + C)+NC A(B + C)(A + N) + NBC 

(3.21) E[Y t )-t B + C _ N B + C-N ' 

(3.22) Cov(F s (0) ,y/ e) ) 

N{A + C)(B + C){A-B + N){t-{A + B))(s -(A-C + N)) 
~ (B + C - N) 2 {B + C - N + 1) ' 

see fl2T7D and (I2T22D . We also get (O) for (?/ 0) ) while (I2T25D takes the form 

(3.23) Var(? t ' 9 W, (e », ?< 9 >) = <^M_A ( + 

u — s + 1 \ [u — s) z u — s 
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Let M be given by ( jXgOJ) with e = 1. With X t = F t (0) - E(T t (0) ), taking 

. . . t(A + N — C)— A — B ... t-1 

(3 ' 24 > 1 'W = M(7V-fl-C) a " d W = M(7V- B -C) 

for £ > 1, we see that 

(3.25) Z t := m'(t)X m r(t)/£i(t) 

defines a Markov process on (1, oo) such that f ll.ip holds. A longer calculation verifies fl X . 3 [) : this 
follows from ( 13.231) . taking into account (I3.2ip . (We remark that Proposition IA. II gives a quadratic 
harness on (0, 1) with parameters rj, 9 swapped , i.e. rj is given by (12. 2 7ft and 9 is given by (12. 26ft . 
This transformation is based on 

m(t) - 1 ~ t ail d i(t) ~ A + N ' C ~ t ( A + B ) 

Then time inversion tZi/ t swaps back the parameters rj, 9 and maps the process onto (1, oo). The 
final transformation is the same as the direct application of (I3.24p . which is how formula f!3.25j) 
was "discovered".) 

We omit the verification of one-sided conditional moments which will fall into place anyway 
since (Z t ) extends to a quadratic harness on (0, oo). □ 

4. Extending quadratic harness: stitching two processes together 

Our goal is to stitch together a pair of randomized Markov processes into a single process. 
(The plan of this construction is based on |BWllbj .) To do so, we chose random variable G with 
distribution (I3.14p . and a pair of Markov chains (Ct)ter on T = (—A — B, oo) and (Q) on T = 
(A + N — C, oo) such that (( t ) and (Q) are O-conditionally independent. The law of (Q) is ), 

with state space {0, . . . , 6} and the law of (Q) is (C,^) with state space {9, + 1, . . . , N — 0}. 
We then define 

Z = (A + C)N + Q(N -B-C), 
and two (Markov) processes Y t = (A + t + Q)(A + ( t ) and Y{ — {t — A — Q{A + Q. (Recall that 
the paths of these processes follow a family of straight lines that do not intersect over T and T, 
so these are indeed Markov processes.) Let X t = Y t — E(Yj) and X' t = Y( — E(F/) denote their 
centered versions. Processes (X t ) te -j-, (X[) te j- together with random variable Z will be stitched 
into a quadratic harness (Z t ) on (0, oo). 

Next we describe the transformations we will use. Let 



y/N(N + A-B)(A + C)(B + C) 

{ ' ' ' y/N-l-B-C 

see fl2T30|) . We then can write f[2T32]) with e = 1 as 

(4.2) £(t) = (t(A + N -C) - A- B)/v and m(t) = (1 - t)/v 
for < t < 1. Similarly, we write (I3.24[) as 

(4.3) £'(t) = (t(A + N — C) — A — B) /v and m\t) = (t - l)/v 
for t > 1. 

The corresponding Mobius transformations are 

<p(t) := £(t)/m(t) = t^-C+^-A-B ^ ^ _ g^y^^ = 

These transformations will be used in the proof. 
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The stitched process is then given by 

{m(t)X v ( t) , 0<t<l, 
Z/v, t = 1, 

m'{t)X' vl{t) , t>l, 

It is convenient to observe that (Z t ) t>0 is a Markov process. Indeed, by Proposition 13.51 this 
follows from Markov property of (Yt), and from 0-conditional independence of (Y t ) and (Y t '). 
The main result of this section is the following. 

Theorem 4.1. For with law ( 13.1 4ft . Markov process (Z t )t>o defined by (I4.4p extends process 
(^t)*e(o,i) /^om Case i o/ Theorem Iff. 51 to a quadratic harness on (0, oo) with parameters \2. 2bV 

\EM) . 

4.1. Proof of Theorem l4.ll We need to verify a number of properties from Definition ll.il These 
will be handled after we establish some auxiliary formulas. 



4.1.1. Auxiliary moment calculations. We first check that E(Z) = 0, Var(Z) = v 2 so that Var(Zi} 
1. This is a consequence of the following lemma. 

Lemma 4.2. For with law ( 13.141) . 

E(9) = ^ + + C C) _ N N , Var(0) = M 2 , 



where M is given by (I2.30p with e = 1. 
That is, 



= N(N + A-B)(A + C)(B + C) 
y } (N-B-C) 2 (N-B-C-1)' 



Proof. See fl3~T3|) . □ 

Lemma 4.3. For with law (13. 14H . ifO<m<k<n<N, and s G T ', u G T then using 
notation ( I3.12p . 

Pr(0 = k\Cs, O = n fc _ Ca (2A + C s + C-u,2A + 2C s + s + 1; C - O- 

Proof. The proof consists of careful isolation of factors that depend only on k in the joint distri- 
bution 

Pr(e = fc,C. = m,C = n) 

= IL k (A + C, A - B + 1; iV)7r mifc (2A + s, s + A + J B)7r n _ fciJV _ fc (2A + 2A; - u, A + C + k) 

(2A + n + m- u) fe _ m (-(n - m)) fc _ m 



const 



N,m,n~ 



(k-m)\(2A + 2m + s + l 



k—m 



(Here constN, m ,n stands for a constant depending on N,m,n and independent of fc.) Details are 
omitted. 
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Proof. Here is a more detailed verification of Lemma 14.31 Isolating the factors that depend on 
k in Pr(0 = k, ( s = m, (' u = n), we obtain 

Pv(e = k,Cs = m,C u = n) = 

TL k (A + C, A - B + 1; N)ir m , k (2A + s, s + A + B)it n _^ N _ k (2A + 2k-u,A + C + k) 

'N\ fk\ [N - k s 



Const N ^ n X (-1) 



X 



k J \m J \n — k 

(A-B + k + l) N - k (A + C) k (A -B + m + l) k - m (A + C + k) n . k 



(2A + s + 2m + l) k _ m (2A -u + k + n) n _ k 

(Here and further, const jv,m,n is n °t necessarily the same at each appearance.) 
Observe that 

(A - B + k + l) N -k{A - B + m + l) fe _ m = (A - 5 + m + l)jv- m , 

(A + C) fc (A + C + fc) n _ fc = (4 + C) n , 

1 _ (2A - u + n + m) k - m 

{2A — u + k + n) n _fc (2A — w + n + m) n _ m 

Since 

N\ f k\ fN -k\ , ^ u 1 



-in .11 II .1 = const N , m J-l) k 



and 



k J \m J \n — k J ' ' (fc — m)!(n — fc)! 

(-(n - m)) fc _ m = const N,m,n{-l) k 



(n-k)V 
we arrive at the formula 

Pr(0 = kXs = m,C = n) = 

(2A -u + n + m)k-m(-(n - m)) fc _ 



const at, 



(fc - m)!(2A + s + 2m + l) fc _ m 
Comparing it with (I3.12p . we get the conclusion of the lemma. □ 



□ 



We will need the first two conditional moments. 
Corollary 4.4. For 6 with law (I3.14p . 

(4.5) E(Q\Y S X) = ^^-A 

u + s 

and 

(A 6) VarfOir Y') - - ^ + ^ = ^ + ^ + *2? 

Proof. For fixed ( s = m, (' u = n, Lemma 14.31 gives 

E(e\( s = m,C = n)=m + E(U), 
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where Pt(U = k) = Hk(2A + m + n — u, 2 A + 2m + s + 1; n — m), so from (I3.13P we get 
(2A + ( s + (' u -u)(C-Q 



E(e|cO = C- 



s + u 

' (Cs(2A + s + Cs) + C(u-2A-0) 



s + u 

This gives f|4~5l) . 

Using (I3.13P again, we get 

Var(8|C„0 

(( s -0(( s + C u + 2A + s)(( s + C u + 2A-u)(s + u-(l l + ( s 



(s + u) 2 (s + u - l; 

This gives (14.61). 



□ 



4.1.2. Covariance of (Z t ). 

Lemma 4.5. The stitched process (Z t ) has covariance (11. ip . 



Remark 4.1. This should hold true for any law of randomization when we write the conversion 
(14.4p by appropriate transformations that depend on the first two moments of 0. 



Proof. From the transformations ( 12.31[) and ( 13.251) exhibited in the proofs of Theorem 12.51 and 
Proposition 13.81 we see that the covariance is as required for < s < u < 1 and for 1 < s < u, so 
by time- reversibility argument it remains only to consider the case s < 1 < u. 

Since lim^oo Y t /t = A + 6, see ( 13. lip , we get Z\ = lim s ^i_ Z s in mean square. Therefore, we 
only need to consider the covariance for s < 1 < u. Denote 

(4.7) s' = <p(s) = £(s)/m(s), u' = <p'(u) = £'(u)/m'(u). 

From ( 14. 4 p we get 

Cov(Z„ Z u ) = m(s)m'(u)Cov(Y s ,, Y^) . 
By conditional independence, from (12.21}) (used with X — Y s /, Y = Y^,, U = 0) we have 

Cov(Y s ,,^,) = Cov(E(Y s ,|0),E(^,|0)). 
So from ( 13 .5p and (13. 19ft we get 

Cov(y s ,, Y^) = {u' - A- N + C)(s' + A + B) Var(0). 

By Lemma [4.21 

Cov(Z s , Z u ) = M 2 m(s)m'(u)(u' - A - N + C)(s' + A + B) 

= M 2 m(s)m'(u) [tp'(u) -A-N + C] [<p(s) + A + B] 

= M 2 [£'{u) -{A + N- C)m'{u)\ [£{s) + {A + B)m(s)} . 

Now we notice that (l2T32|) . see also (fl~2]) . gives £(s) + {A + B)m(s) = s/M, and similarly <K2^ . 
see also ( Q]) r gives £'{u) - (A + N - C)m'{u) = 1/M. Therefore, Cov(Z s , Z u ) = s and 03]) 
holds. □ 
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4.1.3. Harness property. 

Lemma 4.6. Suppose that the law of is (I3.14p . Then (14.41) defines a harness on (0, oo). 

Proof. The transformations (I2.3ip and (13.251) used in the proofs of Theorem 12.51 and Proposition 
13. 8[ show that (11.21) holds for s < t < u < 1 and for 1 < s < t < u. 

To end the proof, we only need to verify (11.21) for s < t = 1 < u. Indeed, if we have this 
case, then the case 0<s<t<l<w, is handled from Markov property as E(Z t \Z s , Z u ) = 
E(E{Z t \Z s , Zx)\Z s , Z u ) = \^-Z s + l ^-E(Z x \Z s , Z u ). The other case 0<s<l<t<wis handled 
similarly (or by time inversion). Finally, the cases 1 = s < t < u and s < t < u = 1 are the limits 
of cases 0<s<l<t<w and 0<s<t<l<u, respectively. 

To prove (II. 2p for s < t = 1 < u, we use notation (14. 7p . The joint distribution Z S ,Z 1 ,Z U is 
determined from the joint distribution of Y S /,Q,Y^,. To verify harness property, we notice that 
Corollary 14.41 implies that E (Zi\Y s /, Y^,) is a linear function of Y s ', Y^,, so it is also a linear function 
of Z S ,Z U . Since by Lemma l4~5l the covariance of (Z t ) is (II. ip . this determines the coefficients of 
the linear regression, and (ll.2p follows. 

□ 

4.1.4. Conditional variance. 

Lemma 4.7. If Q has law ([3714]) . then (TO]) holds for t = 1. 

Proof. Fix < s < 1 < u. Using notation (14. 7p . we see that Var(Zi|Z s , Z u ) = Var(Zx|Y^, Y^,) is a 
constant multiple of the right hand side of (14.61) (with s,u exchanged to s',u'). We do not have 
to pay attention to the deterministic multiplicative constant, say const s ^ which is determined 
uniquely from the covariance of (Z t ). So we write 

(4.8) Var(Z!|Z s ,Z u ) = const s , u [s' 2 Y^, - u' 2 Y s , + s'u'(Y^ Y s ,) + (Y s , + Y^,) 2 ). 

Next, we use the inverse of the transformation (I4.4p . see ( I2.17p . (I3.2ip and ( 14 .7p . 

_Zs_ A{B + C)(A + N) + NBC £{s) A(B + C) + NC 
s> ~ m(s) + B + C -N + m(s) B + C - N 

vZ s - (AB + C(A + N)s) 



1 - s 



Z u £'(u) A(B + C) + NC A(B + C)(A + N)+NBC 



m'(u) m'(u) B + C-N B + C-N 

vZ u - (AB + C(A + N)u) 



u- 1 

Using these expressions, we re-write the right hand side of (14.81) as a deterministic multiple of 



^ (Z u — Z s ) 2 (uz x — sz,y^ 



1+ , ; , „ w „ , ^ X , T/ ; T^^TV V= + 



(A + C)(B + C)N(A-B + N) \ (u - s) 2 (u - s) 2 

__ ((A - B)(B + C) + (A + B + 2C)N)v Z u - Z s 
(A + C)(B + C)N(A -B + N) u-s 
(N 2 + (A — B)N + (A + C)(B + C)) v uZ s - sZ u 
(A + C)(B + C)N(A -B + N) u-s 

2v 2 (Z u - Z s )(uZ s - sZ u ) 



+ 



(A + C)(B + C)N(A -B + N) (u-sf 
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From (14.1 p . we see that up to a deterministic factor this quadratic form matches (jl.3p with 
parameters (I2.26ti2.29p . □ 

4.2. Conclusion of proof. 



Proof of Theorem \4-l\ By Lemma |4.5[ the covariance of our process is (11.11) . From Lemma 14.61 



we see that (II. 2p holds for all < s < t < u. Furthermore from the transformations (I2.3ip and 
( I3.25P exhibited in the proofs of Theorem 12.51 and Proposition 13. 8[ we see that (Z t ) is a quadratic 
harness on (0, 1) and on (1, oo) with the same parameters. Since (jl.2p holds for all < s < t < u, 
from Lemma [4.71 and Lemma IB. II we see that f ll .31) also holds for all < s < t < u. This ends the 
proof. (Recall that the one-sided conditional moments do not need to be verified for processes on 
(0,oo).) □ 
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Appendix A. Conversion to "standard form" 

In this section we recall a procedure that transforms (some) Markov processes with linear 
regressions and quadratic conditional variances into the quadratic harnesses. The following is 
|BWllat Theorem 3.1] specialized to x — 0> V — Vo, $ — ^o> a — 0, r = 1, p — 0, a = M, b = Mip, 
c = Me, d = M5. 

Proposition A.l. Suppose (Y t ) is a (real-valued) Markov process on an open interval T C R 
such that 

(i) E(F t ) = a + (3t for some real a, (3. 

(ii) For s < t in T, Cov(Y;, Yj) = M 2 (tp + s){5 + et), where M 2 (tp + t)(5 + et) > on the 
entire interval T , and that 5 — sip > 0. 

(iii) For s < t < u, 

ir l\r\\r \r \ ( U ^S SY U Y u Y s (Y u — Y s ) \ 

Var(r t \Y„ Y u ) = F t ^ u r) h 9 Q h —. , 

\ U — S U — S [U — Sf J 

where F t ^ SyU is non-random and 8q, r] G R are such that x '■= c*Vo + ft@o + /3 2 > 0. 
Denote X t = Y t — K(Y t ). Then there are two affine functions 

. tS — ip j / \ 1 — te 
t(t) = — — and m{t) 



M(5-eip) w M(5-eip)' 

and an open interval T' C (0, oo) such that Z t := m{t)X^ t y m ^ defines a process (Z t ) on T' such 
that (II. ip holds and (ll.3p holds with parameters 

v = M(6r ]0 + e(2f3 + 9 ))/x, 

9 = M(2(3 + ^ Vo + e )/x, 

a = M 2 e 2 / X , 

r = M 2 /X, 

7 = l + 2e^ar. 

Remark A.l. The time domain T' is the image of T under the Mobius transformation t \- > 
(t + il>)/(et + 6). 
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Appendix B. Extension Lemma 
The following technical lemma is used in Section HI 



Lemma B.l QBWllbJ). Suppose a square-integrable Markov harness Z = (Z t )t>o is a quadratic 
harness on (0,1) and on (l,oo), with the same parameters rj, 9, a, r, 7. IfVax(Z\\Z s ,Z u ) is given 
by the formula (II. 31) with t = 1, and with the same parameters rj,9,o~, r, 7, then Z is a quadratic 
harness on (0, 00). 



K(Z S ,Z U ) 



For completeness, here is a proof from [B Wllbj . 
Denote 

(B.l) A s>t = (Z t -Z s )/(t-s), A s>t = (tZ s -sZ t )/(t-s). 

By time-inversion, it suffices to consider formula (11. 3p in the case s < t < 1 < u. By Markov 
property, 

Var(Z 4 |Z s , Z u ) = E( V&r(Z t \Z s , Z 1 )\Z S , Z u ) + Var(E(Z 4 |Z s , Z 1 )\Z S , Z u ) . 
Denote the right hand side of (11.31) by F ttSU K(Z s , Z u ). Since E(Z t \Z s , Z\) is given by (ll.2p . 

Var(E(Z t |J- S)1 )|J- SjU ) = 7^ \ ^ Var^l^, Z u ) 

it - s)\u - 1) 
(1 — s)(u(l + as) + r — 7s) 
Next, we write 

E(Var(Z t |JT OljT ) = (l-W-s) E (iT(Z s , Zx)[Z s , Z M ). 
1 sex + r + 1 — 57 

Since the coefficient F t , s>u is determined by integrating both sides of (ll.3p . to end the proof, it 
suffices to show that E,(K(Z S , Z\)\Z S , Z u ) is a constant multiple of K(Z S , Z u ), and we do not 
need to keep track of the constants. So it remains to show that 

(B.2) E(K(Z S , Z X )\Z S , Z u ) = C S , U K(Z S , Z u ) 

for any s < 1 < u. 
We have 

(B.3) K(Z S , Z t ) = l+ rjA s>t + 9A s , t + aA\ t + tA% - (1 - 7 )A s , t A M . 

It is easy to check that (jl.2p implies 
(B.4) E(A s , t \F StU ) = A SjU , E(A S|i |jr s>u ) = A s , u . 
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From (IB. 41) we get 

Var(A M |j; jU ) = E(Al t \JT SiU ) - A 2 S>U , 

Vax(A, )t |.F, iU ) = E(A s>t A Sii |J r SiU ) - A s>u A SjU , 

Cov(A S)t , A^l^u) = E(A Sjt A Sji |J : ' SiM ) - A SjU A SjU . 

SinceVar(A S)t | J" S)U ), Var(A S)t | J 7 ^) and Cov(A M , A Sit |.F s>n ) are all proportional to Vav(Z t \J p s>u ), 
see (IB.lj) . we get 



E(A^|j; iU ) = A2 n + 7r l—Var(Z 1 |J- s , u ), 



1-s 



2 



e(a^|j; iU ) = A2 n + ___ Var(Xl |^ )) 

— ^5 

E(A Si iA S!l |J r SjU ) = A SiU A s>u - — — Var(Zi|J r S! „) . 

(1 - s) 2 



By assumption (ii), Var(Zi| J 7 ,^) is proportional to K(Z S , Z u ). Using (IB.3|) . from these formulas 
together with flB.4p we get 

E(K(Z S , Z 1 )\Z S , Z u ) = K(Z S , Z u ) + T + a f + il ~ l)s K{Z S) Z u ), 

(1 - sr 

which proves (1B.2j) . 
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